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Executive  Summary 


Purpose 


Background 


Funding  requirenaents  for  the  National  Aeronautics  and  Space 
Administration  (NASA)  are  expected  to  rise  dramatically  in  the  1990s  and 
could  triple  by  the  year  2000  if  some  recently  proposed  initiatives  such 
as  a  lunar  outpost  or  a  staffed  Mars  expedition  are  adopted.  Contribut¬ 
ing  substantially  to  these  prospective  increases  are  major  existing  and 
planned  research  and  development  projects.  The  current  federal  budget 
deficit  environment  adds  to  the  challenge  facing  congressional 
sionmakers  in  making  increasingly  difficult  choices  about  what  civil 
space  projects  will  be  undertaken  and  the  pace  at  which  they  will  be 
funded.  Reliable  information  on  the  cost  and  progress  of  NASA’s  major 
projects  can  be  a  valuable  resource  for  legislators  when  making  budget 
allocation  decisions. 

NASA’s  four  principal  oversight  Committees  requested  GAO  to  assess 
NASA’s  ability  to  produce  status  reports  that  meet  their  requirements  for 
reliable  cost,  schedule,  and  performance  information  on  major  nasa 
projects.  As  part  of  this  request,  GAO  helped  the  Committees  and  NASA 
agree  upon  project  status  reporting  criteria  and  reviewed  NASA’s  current 
process  for  developing  these  reports  in  a  reliable  manner. 


In  its  report  on  nasa  Issues  (GAO/OCG-89-15TR,  Nov.  1988),  GAO  identified 
NASA’s  incomplete  project  cost  reporting  as  an  issue  to  be  considered  by 
the  incoming  administration  and  the  Congress.  While  developing  that 
report,  GAO  found  that  nasa  had  the  capability  to  report  more  complete 
project  costs  and,  on  occasion,  had  done  so  since  the  mid-1970s  at  the 
request  of  one  of  its  oversight  Committees.  In  these  Project  Status 
Reports,  nasa  had  provided  the  Committee  with  cost,  schedule,  and  per¬ 
formance  information  on  selected  major  projects. 

The  Project  Status  Report  nasa  has  prepared  since  the  mid-1970s  was 
patterned  after  the  Department  of  Defense’s  Selected  Acquisition 
Reports.  The  Subcommittee  on  Veterans  Affairs,  Housing  and  Urban 
Development  and  Independent  Agencies,  Senate  Committee  on 
Appropriations,  specified  the  nasa  projects  to  be  reported.  From  1976 
through  1989,  NASA  prepared  146  reports  on  17  different  projects.  Pro¬ 
ject  Status  Reports  were  initially  submitted  on  January  30  and  July  31 
of  each  year.  However,  since  1987 — following  a  1-year  hiatus  during 
which  none  were  prepared — the  reports  have  been  submitted  annually 
in  March. 
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Executive  Summary 


Results  in  Brief 


New  Project  Status  Report  criteria  for  the  selection  of  projects  for 
reporting,  the  timing  and  duration  of  the  reports,  and  the  report  format 
and  structure  have  been  established  jointly  by  NASA’s  Comptroller’s 
Office  and  the  four  requesting  Committees.  These  criteria  integrate 
NASA’s  reporting  capabilities  with  the  Committees’  requirements  for  cost, 
schedule,  and  performance  information  on  NASA’s  major  projects. 

NASA  is  able  to  produce  the  reports  using  the  new  criteria.  However, 
additional  internal  controls  over  the  process  employed  to  develop 
Project  Status  Reports  are  needed  to  ensure  their  reliability.  Unreliable 
project  status  information  could  mislead  the  reports’  users,  who  rely  on 
them  to  help  make  resource  allocation  decisions. 


Principal  Findings 


New  Criteria  Have  Been 
Established  for  NASA’s 
Project  Status  Reports 


New  criteria  for  nasa’s  Project  Status  Reports  have  been  established 
jointly  by  NASA  Comptroller  officials  and  the  requesting  Committees. 

NASA  is  able  to  develop  the  reports  meeting  the  new  criteria,  and  the 
resulting  information  satisfies  the  Committees’  requirements  for  cost, 
schedule,  and  performance  information  on  NASA’s  major  projects. 

Project  Status  Reports  will  now  be  developed  on  all  nasa  projects  that 
meet  the  nasa  Budget  Administration  Manual’s  definition  of  a  project 
and  are  estimated  to  cost  $200  million  or  more  to  research  and  develop. 
Starting  on  March  15,  1990,  the  reports  will  be  prepared  biannually — as 
of  March  15  and  July  30.  Following  a  project’s  new-start  approval,  the 
reports  will  begin  the  first  March  after  the  project’s  estimate  reaches  the 
cost  threshold  and  end  with  the  report  following  project  completion. 

The  revised  Project  Status  Report  has  six  parts.  Part  I  is  a  narrative 
status  report  highlighting  the  project’s  current  progress  and  problems. 
Parts  II  through  V  track  the  cost,  funding,  schedule,  and  performance  of 
the  project,  as  measured  against  nasa’s  estimates.  Part  VI  presents  key 
project  background  information.  Appendix  II  illustrates  the  revised 
Project  Status  Repon  form. 
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Project  Status  Report 
Process  Needs  Additional 
Internal  Controls 

formalized  its  process  to  develop 

bC^eveloping  written  guidelines  or  specifying  responsibilities  for  de 
oJinrthe  reports.  Guidance  is  informal  and  vague,  as  GAO  found  when  it 
^  A  1 QR9,  rpnort  on  the  Magellan  mission  to  Venus  one  of 

:r«:;  »Vof-dat..  Sd  u.vetmable,  f 

estimates  were  wrong;  some  milestones  were  not  the  most  current,  tne 
latest  acquisition  cost  estimate  lacked  documentation;  the  source  of  the 
upper  stage  development  estimate  was  unknown;  and  official 

S  nS  tell  Lo  who  had  developed  the  “Progress,  Problems  and 
PendiSeciio^^^^  or  upon  what  data  it  was  based,  nasa  offi- 

Lls  disagreed  with  Gao’s  findings  but  provided  no  documentation 
support  their  position. 

Recommendation 

the  NASA  Administrator  examine  NASA  s  pro 

Ss  wXtop  Project  Status  Reports  and  establish  the  i-K™*!  ™  * 
necessary  to  ensure  that  the  Project  Status  Reports  using  the  new 
ria  are  reliable. 

Agency  Comments 

—  As  requested  gao  did  not  ask  nasa  to  comment  officially  on  a  draft  of 
this  report  However,  the  views  of  responsible  officials  were  soug 
toSut  ae  contae  of  oao’s  work,  and  their  comment  were  tncorpo. 

rated  where  appropriate. 

NASA  officials  have  agreed  to  the  new  criteria  and  are  committed  to 
^e^e"d  1  necLary,  revising  the 

ensure  that  the  Project  Status  Reports  delivered  to  the  Congress  are  rei 
able.  They  have  also  agreed  to  prepare  written  guidelines  to  assist  in 
development  of  the  reports. 
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Introduction 


Background 


In  our  report  on  nasa  Issues  (gao/OCG-89-15TR,  Nov.  1988),  we  identified 
the  National  Aeronautics  and  Space  Administration's  (nasa)  incomplete 
project  cost  reporting  as  an  issue  to  be  considered  by  the  incoming 
administration  and  the  Congress.  'While  developing  that  report,  we 
found  that  nasa  had  the  capability  to  report  more  complete  project 
costs.  NASA  has  provided,  on  occasion  since  the  mid-1970s.  Project  Status 
Reports  (psr)  on  selected  nasa  projects  at  the  request  of  the  Chairman  of 
the  Subcommittee  on  va,  hud  and  Independent  Agencies,  Senate 
Committee  on  Appropriations  .  The  purpose  of  the  reports  was  to  pro¬ 
vide  timely  information  on  the  cost,  schedule,  and  performance  of 
selected  major  projects  to  assist  the  Subcommittee  in  its  review  of  NASA's 
budget  requests.  The  projects  were  selected  in  an  ad  hoc  manner, 
according  to  the  Subconunittee’s  interests. 

The  NASA  Comptroller’s  Office  is  currently  the  nasa  focal  point  responsi¬ 
ble  for  preparing  the  psrs.  Once  nasa  receives  a  Subcommittee  request 
for  a  PSR,  the  Comptroller’s  Office  tasks  the  appropriate  nasa  program 
offices  to  submit  psr  information,  collects  and  combines  the  data  pro¬ 
vided,  and  submits  the  PSR  to  the  Subcommittee. 

The  PSRS,  which  were  patterned  after  the  Department  of  Defense's 
Selected  Acquisition  Reports,  include  cost,  schedule,  and  technical  infor¬ 
mation  under  the  following  subject  headings:  mission  and  description; 
progress,  problems,  and  pending  decisions;  mission/technical  character¬ 
istics;  scheduled  milestones;  program  acquisition  cost;  funding;  support 
costs;  and  other  agency  and  foreign  participation. 

The  PSRS  were  initially  submitted  on  January  30  and  July  31  of  each 
year.  Beginning  in  1987,  however — following  a  1-year  hiatus  during 
which  none  were  prepared — nasa  began  to  submit  psrs  annually  in 
March.  From  1976  through  1989,  NASA  developed  146  PSRs  on  17  differ¬ 
ent  projects.  A  complete  schedule  of  these  PSRs  appears  in  appendix  I. 


Objectives,  Scope,  and 
Methodology 


NASA’s  four  principal  oversight  Committees'  requested  that  we  review 
NASA’s  ability  to  produce  psrs  that  meet  their  requirements  for  reliable 
cost,  schedule,  and  performance  information  on  m^or  projects.  As  part 
of  this  request,  we  helped  the  Committees  and  NASA  agree  upon  criteria 


^The  four  requesting  Committees  are  the  Subcommittee  on  VA,  HUD  and  Independent  Agencies. 
Senate  Committee  on  Appropriations;  the  House  Committee  on  Science,  Space  and  Technology:  the 
Subcommittee  on  VA.  HI’D  and  Independent  Agencies,  House  Committee  on  Appropriations;  and  the 
Subcommittee  on  Science.  Technology  and  Space,  Senate  Committee  on  Commerce,  Science,  and 
Transportation. 
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Introduction 


for  project  selection  and  report  timing,  duration,  format,  and  contents. 

We  also  reviewed  nasa’s  current  process  for  developing  these  reports. 

To  ensure  NASA’s  ability  to  develop  the  new  psr,  we  worked  with  person¬ 
nel  from  NASA’S  Comptroller’s  Office  and  used  their  comments  in  the 
development  of  the  Project  Status  Report  criteria.  We  also  integrated 
NASA’s  comments  with  the  Committees’  requirements  to  establish  a  new 
set  of  mutually  agreeable  psr  criteria.  Using  the  requesters’  specifica¬ 
tions,  we  interviewed  representatives  from  each  nasa  program  office  to 
identify  projects  potentially  eligible  for  reporting.^ 

To  assess  the  reliability  of  the  existing  Project  Status  Report  and  the 
process  used  to  prepare  it,  we  selected  one  of  the  seven  1988  psk— the 
space  science  mission  to  Venus  named  Magellan— as  a  case  study.'  A 
NASA  Comptroller  official  told  us  that  the  process  used  to  prepare  psrs 
for  space  science  projects— such  as  Magellan— was  representative  of 
the  process  used  to  prepare  all  NASA  PSRs.  We  chose  the  space  science 
project  Magellan  because  it  had  a  nearly  completed  and  relatively 
uncomplicated  development  history. 

We  focused  our  work  on  nasa's  Comptroller’s  Office  and  the  Office  of 
Space  Science  and  Applications  at  NASA  Headquarters  in  Washington, 
D.C.  We  also  performed  work  at  the  Jet  Propulsion  Laboratory  in 
Pasadena.  California. 

As  requested,  we  did  not  obtain  written  comments  on  a  draft  of  this 
report.  However,  we  obtained  the  views  of  agency  officials  and  consid¬ 
ered  them  throughout  the  preparation  of  this  report.  Our  work  was  per¬ 
formed  from  November  1988  to  November  1989  in  accordance  with 
generally  accepted  government  auditing  standards. 


^NASA  has  five  program  of fices— the  Office  of  Space  Science  and  Applications,  the  Ofte  of  Space 
Flight,  the  Office  of  Aeronautics  and  Space  Technology,  the  Office  of  Space  Station,  and  the  Office  o 
Space  Operations. 


^In  1988  NASA  prepared  PSRs  for  the  Ulysses, 
National  Aerospace  Plane,  Upper  Atmospheric 


Mars  Observer,  Galileo,  Hubble  Space  Telescope, 
Research  Satellite,  and  Magellan  projects. 
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New  Project  Status  Report  Criteria 


New  criteria  for  nasa's  Project  Status  Reports  have  been  jointly  estab¬ 
lished  and  agreed  to  by  nasa  Comptroller  officials  and  representatives 
from  NASA’s  four  oversight  Committees.  These  criteria  address  the  selec¬ 
tion  of  projects  for  reporting,  specify  the  timing  and  duration  of  reports, 
and  set  out  their  format  and  structure.  By  adhering  to  the  criteria,  nasa 
will  provide  the  Committees  with  timely  cost,  schedule,  and  perform¬ 
ance  information  on  its  major  projects. 


PSR  Selection,  Timing, 
and  Duration 

.  an  undertaking  with  a  scheduled  beginning  and  ending,  which  norntally 
involves  one  of  the  following  primary  purposes:  ( 1 )  the  design,  development  and 
demonstration  of  major  advanced  hardware  items;  (2)  the  design,  construction  and 
operations  of  a  new  launch  vehicle  (and  associated  ground  support)  during  the 
research  and  development  phase;  and  (3)  the  construction  and  operation  of  one  or 
more  aeronautical  or  space  vehicles  and  necessary  ground  support  in  order  to 
accomplish  a  scientific  or  technical  objective." 


PSRs  will  be  prepared  on  all  NASA  projects  that  (1)  meet  the  nasa  Budget 
Administration  Manual's  definition  of  a  project  and  (2)  are  estimated  to 
cost  $200  million  or  more  to  research  and  develop.  The  NASA  manual 
defines  a  project  as 


The  Committees’  representatives  set  a  minimum  cost  criterion  to  limit 
PSRS  to  NASA’s  higher  cost  projects.  The  cost  criterion  was  set  at  a  mini¬ 
mum  research  and  development  cost  estimate  of  200  million  real-year 
dollars.'  This  cost  criterion  can  be  re-examined  in  future  years  and 
adjusted  upward  to  account  for  inflation. 

Using  these  criteria,  we  asked  officials  in  each  of  nasa's  program  offices 
to  supply  lists  of  their  currently  eligible  projects.  On  the  basis  of  these 
lists  and  in  consultation  with  the  Committees’  representatives,  we  pre¬ 
pared  a  list  of  19  projects  eligible  for  the  next  psr  process  beginning  in 
March  1990,  as  shown  in  table  2. 1 . 


'  Real-year  dollars  include  estimates  of  inflation  in  future  years. 
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Table  2.1:  NASA  Projects  Eligible  lor 
March  1990  PSRs,  Listed  by  NASA 
Program  Office 


Program  office 

Project 

Space.  Science 
and  Applications 

Advanced  X-Ray  Astrophysics  Facility 

Advanced  Communications  Technology  Satellite 

Comet  Rendezvous  Asteroid  Flyby/Cassini’ 

Extreme  Ultraviolet  Explorer 

Galileo 

Gamma  Ray  Observatory 

Global  Geospace  Science 

Hubble  Space  Telescope 

Magellan 

Mars  Observer 

Ocean  Topography  Experiment 

Ulysses 

Upper  Atmospheric  Research  Satellite 

Space  Flight 

Advanced  Solid  Rocket  Motor 

Orbital  Maneuvering  Vehicle 

Replacement  Orbiter 

Space  Station’’ 

Hiight  Teierobotic  Servicer 

Aeronautics  and  Space 
Technology 

National  Aerospace  Plane 

space  Operations 


I  racking  and  Data  Relay  Satellite  System 


^Although  the  Comet  Rendezvous  Asteroid  Flyby  and  Cassini  are  two  separate  missions  NASA  is 

anSes?onTs  ma  "^'"Sress  in  development,  the  cost  estimates 

pro^ec  *  '' become  necessary  to  develop  separate  PSRs  for  each 


Jhe  Committees-  representatives  and  NASA  officials  agreed  that  the  Space  Station  Car^ital 

muZTA  h"'  ^  station-This  plan-as  directed  by  the 

labB  NASA  Authorization  Act— inctudes  a  statement  outtining  the  projected  total  cost  schedule  ^and 

brJlfb™  led  a  each  of  the  fiscal  years  1989  through  1996  and  to 

be  submitted  along  with  the  President  s  annual  NASA  budget  request  ^ 


The  Committees  representatives  and  nasa  officials  agreed  that  the  psrs 
for  projects  meeting  the  eligibility  criteria  would  be  prepared  biannu- 
ally  as  of  March  15  and  July  30 — so  they  are  available  for  use  both  at 
the  beginning  of  the  budget  review  process  and  at  the  end  during  the 
final  framing  of  the  spending  bills.  These  due  dates,  which  closely  coin¬ 
cide  with  NASA’s  biannual  cost  estimating  process  (on  March  1  and 
July  1),  will  enable  the  psrs  to  reflect  current  information. 


PSRS  on  eligible  projects  will  be  submitted  during  the  first  March  follow¬ 
ing  congressional  new-start  approval  or  later  when  they  reach  the 
$200  million  cost  threshold^  and  end  with  a  final  psr  after  project  com¬ 
pletion.  For  the  purpose  of  the  psr,  project  completion  is  defined  as  the 


-A  PSR  IS  prepared  for  a  project  when  it  reaches  the  5200  million  cost  threshold  for  its  total  esti- 

wars  aft^rtte  Sometimes  a  project  may  not  meet  this  threshold  until  months  or 

years  alter  tne  initial  congressional  new-start  approval. 
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New  Project  Status  Report  Criteria 


time  when  NASA  can  assess  how  well  the  project  has  achieved  its  objec¬ 
tives.  See  appendix  III  for  a  more  detailed  discussion  of  project 
completion. 


Format  for  the  New 
PSR 


The  Committees'  representatives  approved  the  following  six-part  psr 
format: 

Part  I  -  Project  Status, 

Part  II  -  Project  Cost  Estimates, 

Part  III  -  Funding  for  Project  Development, 

Part  IV  -  Principal  Milestones, 

Part  V  -  Project  Goals  and  Objectives,  and 
Part  VI  -  Project  Background. 


Each  part  is  briefly  described  below.  Appendix  II  provides  an  illustra¬ 
tion  of  the  revised  psr,  and  in  appendix  III  we  describe  its  data  elements 
and  suggest  source  documents  for  its  development. 

Part  I  -  Project  Status”  calls  for  a  brief  narrative  summary  highlighting 
the  project’s  most  recent  progress  and  any  problems  identified  in  other 
parts  of  the  psr.  This  section  also  requires  a  description  of  corrective 
actions  taken  or  planned  by  nasa  to  mitigate  the  negative  impacts  of  any 
problem  identified. 

“Part  II  -  Project  Cost  Estimates”  requires  that  the  amount  and  reason 
for  project  cost  growth  be  tracked  over  time.  It  requests  two  project  cost 
estimate  baselines— the  initial  project  cost  estimate  that  is  developed 
when  NASA  first  requests  new-start  approval  and  the  development  cost 
estimate  that  nasa  managers  prepare  after  they  have  a  fuller  picture  of 
project  costs  (usually  at  the  time  of  a  project’s  Preliminary  Design 
Review).^ 

Part  II  requires  that  nasa  cost  estimates  be  tracked  over  time  for  the 
NASA  cost  components— costs  for  the  primary  program  office  and  the 
supporting  program  offices.  Estimates  of  project  costs  incurred  outside 
of  NASA  (by  other  U.S  agencies  and  other  participants)  will  also  be  listed 
in  Part  II.  Because  these  estimates  are  developed  by  NASA’s  partners, 

NASA  officials  will  only  be  responsible  for  reporting  the  latest  estimates 
provided  to  them  by  these  partners. 


’The  Preliminary  Design  Review  is  NASA’s  technical  review  of  the 
producibility  and  conipatibiJity  with  the  project's  requirements. 


project's  basic  design 


to  ensure  its 


Page  14 


NASA  Project  Status  Reports 


Chapter  2 

New  Project  Status  Report  Criteria 


“Part  III  -  Funding  for  Project  Development”  requires  that  the  project’s 
research  and  development  funding  be  displayed  in  three  ways — citing 
what  has  been  funded,  what  is  currently  available,  and  what  is  needed 
for  the  future. 

“Part  IV  -  Principal  Milestones”  requires  that  the  progress  towards  and 
the  completion  of  key  milestones  be  charted.  Key  milestones  include 

•  the  date  of  the  announcement  of  science  opportunity  to  the  community 
of  scientists  outside  of  nasa  (if  applicable), 

•  the  date  that  development  contracts  are  awarded, 

•  the  date  when  all  Preliminary  Design  Reviews  are  completed, 

•  the  date  that  all  Critical  Design  Reviews  are  completed,-* 

•  the  launch  date,  and 

•  the  date  of  project  completion. 

Part  IV  also  requires  two  baselines — the  “initial  project  estimate”  and 
an  updated  “development  estimate.” 

“Part  V  -  Project  Goals  and  Objectives”  requires  a  summary  of  the  pro¬ 
ject's  goals  and  objectives  (technological  and/or  scientific),  as  defined  by 

NASA 

•  in  its  initial  project  presentation  to  the  Congress, 

•  in  its  project  development  estimate,  and 

•  in  its  assessment  of  final  project  performance. 

“Part  VI  -  Project  Background”  requires  project  information  regarding 

•  the  project’s  relationship  to  NASA’s  strategic  plan  and  its  contribution  to 
other  NASA  missions; 

•  the  general  background  of  the  project,  including  when  it  was  approved 
as  a  new-start  and  the  time  and  amount  spent  on  it  during  “advanced 
studies”;** 

•  the  NASA  components  primarily  involved  and  the  extent  of  their 
involvement; 

•  the  prime  contractors  and  what  they  are  to  deliver  to  nasa;  and 

•  the  roles,  responsibilities,  and  contributions  of  other  involved  partici¬ 
pants,  such  as  domestic  and  foreign  commercial  and  academic  entities. 


*The  Critical  Design  Review  is  NASA's  review  of  the  detailed  design  when  it  is  approximately 
90-percent  complete  to  ensure  that  the  project  design  is  in  compliance  with  NASA  requirements. 

'’■‘Advanced  studies”  is  NASA’s  term  for  all  pre-project  research  activities. 
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Conclusion 


New  criteria  for  the  selection  of  projects  for  psr  reporting,  the  timing 
and  duration  of  the  PSR  reports,  and  the  psr  report  format  and  structure 
have  been  agreed  to  by  nasa  and  the  requesting  Committees.  The  criteria 
integrate  NASA’s  reporting  capabilities  with  the  Committees  require¬ 
ments  for  timely  cost,  schedule,  and  performance  information  on  nasa’s 
major  projects. 
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to  follow  the  new  PSR  criteria  N"eds 
additional  internal  controls  to  ensure  the  preparation  of  reliable  PSRs^ 
NASA  has  had  an  informal  process  for  developing  psrs.  In  attempting  to 
trace  and  verify  the  information  in  one  representative  psr— the  March 
1988  Magellan  psR— we  found  that  NASA  needs  to  improve  that  process. 
NASA  must  ensure  that  there  are  adequate  internal  controls  in  plare  to 
guide  the  preparation  and  processing  of  psrs  that  are  current,  accura  e, 
complete,  and  satisfy  the  basic  criteria  outlined  in  chapter  2. 


PSRs  Need  to  Be 
Reliable 


Funding  requirements  for  NASA  are  expected  to  rise  dramatically  in  the 
1990s  and  could  triple  by  the  year  2000  if  some  recently  proposed 
research  and  development  initiatives  such  as  a  lunar  outpost  or  a 
staffed  Mars  expedition  are  adopted.  In  the  current  budget  deficit  envi¬ 
ronment,  budget  decisionmakers  face  increasingly  difficult  decisions  on 
NASA  budget  allocations.  They  must  decide  what  civil 
be  undertaken  and  the  pace  at  which  they  will  be  funded.  Reliable  cost, 
schedule,  and  performance  information  on  nasa’s  major  projects  can 
help  in  making  these  decisions. 

NASA  provides  the  Congress  with  information  on  its  research  and  devel¬ 
opment  activities  through  testimony,  budget  estimates,  and  various 
reports;  however,  none  of  these  methods  provides  the  comprehensive 
and  focused  information  the  revised  psr  will  provide.  The  reR  will  pro¬ 
vide  congressional  decisionmakers  with  a  concise  picture  of  the  cost, 
schedule,  and  performance  status  of  NASA’s  major  projects. 

Congressional  use  of  the  psr  should  reduce  the  frequency  and  volume  of 
ad  hoc  information  requests  to  nasa’s  project  managers.  For  example, 
before  Che  annual  budget  hearings,  one  of  nasa’s  oversight 
Subcommittees  typically  requests  projected  total  cost  estimates  for  a 
major  projects,  information  that  another  Subcommittee  also  requests  in 
reviewing  project  status.  These  types  of  requests  can  be  satisfied  by  the 
revised  psr.  However,  for  the  psr  to  be  a  viable  alternative  to  many  ad 
hoc  requests  for  information,  as  well  as  to  serve  as  a  reliable  source  o 
cost,  schedule,  and  performance  information,  it  must  contain  accurate, 
complete,  and  current  information. 
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PSR  Process  Needs 
Additional  Internal 
Controls 


In  order  to  understand  NASA’s  reporting  capabilities,  we  selected  the 
March  1988  Magellan  psr  as  a  case  study  and  attempted  to  race  is 
“„d  to  [dentity  L  supporUng  dpcumentation.  We  found  the  procos, 
to  be  vague  and  confusing. 

NASA  does  not  have  formal  instructions  specifying  the  method  for 
deveZLnt,  the  responsibilities  of  the  individual  nasa  program  offices 
involved,  or  procedures  for  psr  verification  and  review.  Furthermore, 
none  of  the  Comptroller  and  program  office  officials  we  interviewed 
could  completely  explain  the  informal  PSR  procedures  being  used  or  iden¬ 
tify  all  the  individuals  responsible  for  the  preparation  of  specific  1>SR 
information  or  the  sources  of  such  information. 

The  procedures  employed  by  nasa  to  produce  a  psr  f 

verify  the  accuracy  of  project  information,  nasa  Comptroller  officials 
told  us  that  psr  information  was  generally  prepared  by  updating  a  copy 
of  the  last  psr  with  handwritten  corrections.  NASA  project  and  resource 
management  officials  told  us  that  several  program  offices  rnay  comment 
on  a  particular  psr  in  this  manner,  and  nasa  Comptroller 
responsible  for  reviewing  the  psrs  have  no  record  of  where  certain  !>SR 

information  originated. 

In  tracing  the  sources  of  information  used  in  the  March  1988  Magellan 
PSR,  we  found  data  that  was  wrong,  out-of-date,  and  unverifiable. 

.  The  upper  stage  ’’prior  years”  and  “FY  1988”  funding  figures  were 
wrong  The  figure  reported  in  the  March  1988  Magellan  psr  for  upper 
stage  “prior  year”  funding  was  S15.2  m.^m  According  to  NASA  of fn 
dais  it  should  have  been  $20.0  million.  The  funding  tor  FY  1988  was 
shown  as  $32.5  million,  when  it  actually  was  $27.7  million,  according  to 
NASA  Comptroller  officials.  The  nasa  Comptroller  official  responsible  for 
these  figures  told  us  that  the  person  who  prepared  them  must  have 
made  a  mathematical  error. 

.  The  milestones  reported  in  the  psr  for  “Delivery  of  Spa^craft  to  KSC 
IKennedy  Space  Center]”  and  “Launch”  had  not  been  updated  w'th  the 
latest  information  available  at  the  time  of  the  psr  s  development  The 
PSR  which  stated  that  its  data  was  current  as  of  January  31,  1988,  mdi 
cated  “Delivery  of  Spacecraft  to  KSC”  during  the  first  quarter  of  calen¬ 
dar  year  1988.  Yet  the  December  1987  Project  Management  Report- 
which  was  accurate  according  to  na.sa  Comptroller  officials-listed  this 
date  as  the  fourth  quarter  of  1988.  Similarly,  the  psr  listed  '  Launch  for 
?h  “  “ond  Q.,a®r .*„d.r  year  1988.  yat  the  Project  Maitagement 
Report  listed  it  for  the  first  quarter  of  1989.  A  nasa  Comptrollei  ottKial 
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explained  that  these  discrepancies  had  resulted  from  typographical 
errors. 

Finally,  unverifiable  information  was  pervasive  in  the  Magellan  psr.  For 
example,  the  nasa  officials  responsible  for  the  material  in  the  “Progress, 
Problems  and  Pending  Decisions”  section  of  the  psr  could  not  tell  us  who 
had  prepared  it  or  upon  what  data  it  was  based.  Similarly,  nasa 
Comptroller  officials  did  not  know  the  origin  of  the  development  esti¬ 
mate  for  the  Centaur  upper  stage,  nasa  officials  also  told  us  that  the 
Current  Estimate”  for  Magellan  acquisition  cost  had  not  been 
documented. 

NASA  officials  disagreed  with  our  finding  that  some  data  in  the  1988 
Magellan  psr  was  wrong,  out-of-date,  and  unverifiable.  Although  they 
promised  to  provide  us  with  documentation  that  would  support  this 
position,  the  evidence  was  not  forthcoming. 


During  our  review  of  the  March  1988  Magellan  psr,  we  found  data  that 
was  inaccurate,  out-of-date,  and  unverifiable.  We  also  found  that  the 
current  process  used  to  develop  psrs  needs  additional  internal  controls 
to  ensure  reliable  psr  data.  If  the  psr  data  is  unreliable,  the  report  can¬ 
not  be  used  as  a  basis  for  sound  resource  allocation  decisions.  In  order  to 
ensure  the  reliability  and  usefulness  of  the  psrs,  nasa  needs  to  establish 
adequate  internal  controls  for  preparing,  processing,  and  reviewing  psrs. 
These  controls  are  especially  important  as  psrs  change  from  ad  hoc 
reports  on  relatively  few  projects  to  routine,  biannual  reports  on  many 
more  projects. 


Specific  internal  controls  to  strengthen  nasa’s  development  of  psrs  that 
meet  the  new  criteria  described  in  chapter  2  should  begin  with  NASA’s 
developing  and  institutionalizing  psr  guidelines.  These  guidelines  should 

•  identify  an  accountable  nasa  focal  point  who  will  ensure  that  PSRs  are 
reliable  and  meet  the  prescribed  criteria  for  project  eligibility,  report 
timing  and  duration,  format,  and  contents; 

•  identify  the  nasa  offices  responsible  for  each  specific  part  of  the  psr; 
specify  the  sources  of  data  to  be  used  when  preparing  the  psr; 

•  establish  verification  and  review  procedures;  and 

•  establish  and  maintain  a  complete  historical  file  of  psrs. 

NASA  officials  have  agreed  to  review  and,  if  necessary,  revise  the  current 
process  used  to  develop  the  psrs  to  ensure  that  the  psrs  delivered  to  the 
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Congress  are  reliable.  In  doing  so,  nasa  has  also  agreed  to  develop  writ¬ 
ten  guidelines  for  preparing  PSRS  and  to  base  the  guidelines  on  the  infor¬ 
mation  provided  in  this  report. 


Recommendation  to 
the  NASA 
Administrator 


We  recommend  that  the  nasa  Administrator  examine  NASA's  process  to 
develop  Project  Status  Reports  and  establish  the  internal  controls  neces¬ 
sary  to  ensure  that  the  Project  Status  Reports  using  the  new  criteria  are 
reliable. 
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Project  Status  Reports  Filed  in  the  NASA 
Comptroller’s  Office 


Submission  dates 


1 .  Space  Shuttle 

1/30/76, 1/31/77, 7/31/77, 1/31/79,  3/05/80, 
7/31/80, 1/31/81, 7/31/81, 1/31/82,  7/31/82, 
1/31/83 

2  HEAO  A-C 

1/30/76,  7/31/76,  1/31/77, 7/31/77,  1/31/78, 
7/31/78, 1/31/79, 7/31/79, 3/05/80,  7/31/80 

3  Mariner  Jupiter/Saturn  Voyager 

1/30/76,  7/31/76,  1/31/77.  7/31/77,  1/31/78, 
7/31/78,  1/31/79,  7/31/79, 3/05/80,  7/31/80, 
1/31/81,7/31/81,  1/31/82 

4.  Pioneer  Venus 

1/30/76, 7/31/76, 1/31/77,  7/31/77,  1/31/78, 
7/31/78,1/31/79,7/31/79  _ 

5  SEASAT-A  or  1 

1/30/76.7/31/76,  1/31/77,7/31/77,  1/31/78, 
7/31/78, 1/31/79, 7/31/79 

6  LANDSAT-C 

1/30/76, 7/31/76, 1/31/77,  7/31/77,  1/31/78, 
7/31/78, 1/31/79, 7/31/79 

7.  LANDSAT-D 

1/31/78,7/31/78, 1/31/79,  7/31/79,  3/05/80, 
7/31/80. 1/31/81,7/31/81, 1/31/82,  7/31/82, 
1/31/83,7/31/83 

8  Hubble  Space  Telescope 

1/31/78, 7/31/78,  1/31/79,  7/31/79, 3/05/80, 
7/31/80, 1/31/81.7/31/81,  1/31/82,7/31/82, 
1/31/83. 7/31/83, 7/31/84, 1/31/85, 3/25/87, 
3/23/88, 3/30/89 

9.  Galileo 

1/31/78,  7/31/78,  1/31/79, 3/05/80.  7/31/80, 
1/31/81, 7/31/81, 1/31/82,  7/31/82.  1/31/83, 
7/31/83,  1/31/84,  7/31/84, 1/31/85,  3/25/87 
3/23/88, 3/30/89 

10,  Ulysses 

1/31/79,  7/31/79,  3/05/80,  7/31/80, 1/31/81. 
7/31/81.  1/31/82,7/31/82. 1/31/83,  7/31/83, 
1/31/84,  7/31/84, 1/31/85, 3/25/87.  3/23/68, 
3/30/89 

1 1 .  Gamma  Ray  Observatory 

1/31/81, 7/31/81,  1/31/82,  7/31/82, 1/31/83, 
7/31/83. 1/31/84, 7/31/84, 1/31/85 

12,  Magellan 

1/31/84,  7/31/84. 1/31/85,  3/25/87,  3/23/88, 
3/30/89  _ 

13.  Upper  Atmospheric  Research  Satellite 

3/25/87, 3/23/88,  3/30/89 

14,  Mars  Observer 

3/25/87,  3/23/88, 3/30/89 

15.  National  Aerospace  Plane 

3/25/87,  3/23/88,  3/30/89 

16.  Comet  Rendezvous  Asteroid  Flyby/ 

3/30/89 

Cassini 

17,  Advanced  X-Ray  Astrophysics  Facility 

3/30/89 
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Project  Status  Report  Form 


Appendix  O 

Project  Status  Report  Form 


PART  II—  PROJECT  COST  ESTIMATES 
(Real-Year  Dollars  in  Thousands) 

( 

!  COST 

!  COMPONENTS 

NITIAL  PROJECT  DEVELOPMENT'  LAST  PSR  '  THIS  PSR  .  AMOUNTOFAND 

ESTIMATE  ESTIMATE  1  ESTIMATE  _  ESTIMATE  REASON  FOB  CHANGE  | 

1  PRIUARV  NASA 

PROGRAM  OPPICE 
■  nPFirFNAMF 

i 

'  *  i 

! 

_ i _ _ _ _ _ — - n 

!  SUPPORTING  NASA 

PROGRAM  OPP'CES 

1 

1 

1  '  i  ! 

1 

i 

NASA  SUBTOTAL 

OTHER  U  S  AGENCIES 

i  '  ■  1 

1  i  ,  1 

•  1  1  J 

OTHER  U  S  PARTICIPANTS 

i  ■  ■  1 

i  ’  -i _ 

NON-NASA  SUBTOTAL 

- -  ^  P 

1 

TOTAL 

( 
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PART  Hi  —  FUNDING  FOR  PROJECT  DEVELOPMENT 
(Real-Year  Dollars  in  Thousands) 


PHIOR 

YEARS 


CURRENT 

PROJECT 

DEVELOPMENT 

COST 

ESTIMATE 


I  PROJECT  DEVELOPMENT 

I  Funding 


part  IV—  PRINCIPAL  MILESTONES 
(Calendar  Year  and  Month) 


MILESTONES 

INITIAL  PROJECT 
ESTIMATE 

DEVELOPMENT 

ESTIMATE 

(-ASTPSR 

THIS  PSR; 
ACTUAL* 

REASON  FOR  CHANGE 

ANNOUNCEMENT  OF 
OPPORTUNITY 

development  contracts 

AWARDED 

ALL  PRELIWiNARV 

DESIGN  REVIEWS 

completed 

;  At:  CRITICAL  DESIGN 
REVIEWS  COMPLETED 

launch  DATE 

PROJECT  COMPLETION 

_ _ 1 
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Project  Status  Report  Form 


PART  VI  —  PROJECT  BACKGROUND 


PBOjECI  5  BEL»:'ONSHIP  TO  NASA  S  SIRAIFGIC  PLAN 


GENERAL  BACKGROUND 


PBIMAHV  NASA  COMPONENTS  ANO  IHF.IB  BESPONSIBILITIES 


PBIME  CONTBACIORS  AND  THEIR  BESPONSIBILi' lES 


3-HER  paHTICIPANTS  ANO  their  RESPONSIBi'lI'iES 
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Completing  the  PSR  Form 


This  appendix  describes  the  contents  of  the  revised  psr  form  and,  where 
appropriate,  identifies  source  documents  that  could  be  used  to  complete 
it^Whenever  possible,  information  reported  in  the  psr  should  correspond 
to  information  contained  in  NASA’s  internal  automated  cost  reporting 
system.’ 

As  depicted  in  figure  III.  1,  the  heading  information  includes  the  project 
name  and  the  date  the  psr  is  submitted  to  the  Committees,  The  table  of 
contents  for  the  psr  is  self-explanatory.  Each  individual  PSR  part  is  dis¬ 
cussed  below,  including  an  explanation  of  what  information  should  be 
included  in  each  of  the  parts. 


Figure  lltt:  PSR  Heading  and  Table  ot  Contents 


Project  Name; 


PROJECT  STATUS  REPORT 

Submission  Date; _ _ 


Part  1 

Table  of  Contents 

Project  Status 

Page 

1 

Part  11 

Project  Cost  Estimates 

2 

Part  III 

Funding  for  Project  Development 

3 

Part  IV 

Principal  Milestones 

3 

PartV 

Project  Goals  and  Objectives 

4 

1 

Part  VI 

Project  Background 

5 

i 

’  NASA’s  Division  of  Finanaal  Management  maintains  the  Financial  and  Contractual  StaWs  tF.ACS) 
da^  whirret«rts  all  NA.SA  financial  activity.  This  database  employs  an  automated 
Agencyw'ide  Coding  Structure  system,  which  identifies  NASA  s  financial  activities  y  proje 
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Part  I  -  Project  Status 


“Part  I  -  Project  Status"  summarizes  the  progress  and/or  problems  with 
a  project’s  cost,  schedule,  and  performance.  Part  I  explains  NASA's  cor¬ 
rective  actions  planned  to  mitigate  the  negative  effects  of  any  problem 
on  the  project’s  progress,  such  as  requesting  additional  or  reprogram¬ 
ming  existing  funding  or  de-scoping  project  objectives.  The  narrative 
should  be  tailored  to  fit  in  the  space  provided  on  the  first  page  of  the 
PSR.  (See  figure  III.2.) 


~igure  III.2:  Part  1 

-  Project  Status 

Part  1  —  Project  Status 

j 

Part  II  -  Project  Cost 
Estimates 


“Part  II  -  Project  Cost  Estimates”  tracks  the  amount  of  and  reason  for  a 
project’s  cost  growth  over  time.  Project  cost  components  are  listed  verti¬ 
cally  down  the  left-hand  column  and  then  tracked  horizontally  by  the 
estimate/change  columns.  (See  figure  III. 3.) 
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Figure  111.3:  Project  Cost  Estimates _ _ _ _ _ _ _ 

PART  II  —  PROJECT  COST  ESTIMATES 
{Real-Year  Dollars  In  Thousands) 
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The  NASA  cost  components  include  the  “Primary  NASA  Program  Office 
and  the  “Supporting  nasa  Program  Offices.”  (See  figure  III.3.)  The  Pri¬ 
mary  NASA  Program  Office”  is  the  program  office  at  nasa  Headquarters 
responsible  for  the  oversight  of  research  and  development  costs  that  are 
unique  to  the  project.  The  presentation  of  these  costs  should  be  consis¬ 
tent  with  NASA’s  cost  reporting  terminology  and  therefore  will  vary  by 
project.  For  example,  nasa  usually  displays  the  primary  program  costs 
for  a  science  project,  such  as  Magellan,  as  "Project  Development  and 
“Mission  Operations  and  Data  Analysis”  (mo&da).  On  the  other  hand,  for 
an  operational  project,  such  as  the  Tracking  and  Data  Relay  Satellite 
System  (tdrss),  nasa  may  display  the  primary  program  costs  as  Design, 
Development,  Test  and  Evaluation”  (ddt&e)  and  “Operational  Capability 
Development.” 

On  the  basis  of  these  examples,  “Project  Development”  costs  for  a  sci¬ 
ence  project  are  costs  incurred  to  develop  the  spacecraft,  the  costs  of 
experiments/instruments,  and  the  costs  of  ground  operations.  “MO&Da” 
costs  are  the  costs  to  operate  the  spacecraft  and  to  analyze  the  data 
transmitted  to  Earth.  For  the  purposes  of  the  psr,  the  mo&da  estimate 
ends  when  the  mission  has  completed  its  original  objectives.  (We  define 
“Project  Completion”  in  our  section  on  “Milestones,”  p.  36.) 

For  a  project  with  an  operational  objective,  “ddt&e”  is  used  to  refer  to 
costs  incurred  to  design,  develop,  test,  and  evaluate  the  project. 
“Operational  Capability  Development”  is  the  term  nasa  uses  to  refer  to 
costs  incurred  by  the  primary  program  office  to  prepare  the  system  for 
its  full  operational  capability.  For  example,  “Operational  Capability 
Development”  costs  for  the  Tracking  and  Data  Relay  Satellite  System 
could  include  the  nasa  Budget  Estimate  line  items  “Space  network  oper¬ 
ations,”  “System  engineering  and  support,”  and  “Second  TDRSS  ground 
terminal." 

The  “Supporting  nasa  Program  Offices”  estimates  include  costs  incurred 
by  other  offices  primarily  or  exclusively  in  support  of  the  project. 
Examples  include 

.  the  costs  incurred  by  the  Office  of  Space  Operations  in  providing  any 
project-related  tracking  and  data  acquisition  services, 

.  the  marginal  cost  of  a  launch  when  the  space  shuttle  is  required  to 

launch  a  specific  project,  such  as  Magellan  (currently  estimated  by  NASA 
officials  to  be  -$50  million); 
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Non-NASA  Cost 
Components 


SoXg  to  latest  Lt  estimates  made  available  to  it  b^not 
responsible  for  the  completeness  or  accuracy  of  such  estimates. 


Figure  III.4:  Non-NASA  Cost  Components 


loTHER  U,  S.  AGENCIES 


OTHER  PARTICIPANTS 


[non-NASA  SUBTOTAL 


•'Other  U.S.  Agencies”  estimates  include  costs  to  other  federal  agencies 
to  suDDlv  NASA  With  goods  and  services  m  support  of  a  project  For 
example,  the  cost  incurred  by  the  Department  of  Energy  ™ 
the  co^st  to  develop  and  deliver  nuclear  power  supply  equipmen  . 

••Other  Participants”  estimates  include  planned  expenditures  (in  equiva¬ 
lent  U  S  dollars  for  foreign  participants)  by  any  foreign  govei^e 
and/or  international  and  domestic  commercial  or  academic  entities  tl^at 
c^SSS^  to  the  project:  for  example,  the  estimated  cost  to  the 
Federal  Republic  of  Germany  to  provide  the  propulsion  system  for 
Comet  Rendezvous  Asteroid  Flyby  project. 
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Estimate/Change  Columns 


The  column  headings  "Initial  Project  Estimate,”  "Development 
Estimate  ”  "Last  PSR  Estimate,”  and  “This  psr  Estimate  help  track  pro¬ 
ject  estimates  over  time.  The  “Amount  of  and  Reason  for  Change-col¬ 
umn  explains  any  change  between  the  last  and  current  psrs  (See  figure 
III.5.)  Similar  headings  are  used  again  in  "Part  IV  -  Principal  Milestones 
to  track  the  project’s  schedule  and  in  “Part  V  -  Project  Goals  an 
Objectives”  to  track  the  project’s  performance.  Therefore,  the  following 
discussion  on  estimate/change  columns  should  also  be  used  when  com¬ 
pleting  those  parts  of  the  psr. 


Rqure  III.5:  Part  II  -  Column  Headings  - - - - 

INITIAL  PROJECT 
ESTIMATE 

DEVELOPMENT 

ESTIMATE 

last  psr 

ESTIMATE 

_ _ _ 

THIS  PSR  1 

1  ESTIMATE  1 

- , 

amount  of  and 

REASON  FOR  CHANGE 

The  first  column,  "Initial  Project  Estimate,”  displays  the  original  cost 
estimates  nasa  presented  to  the  Congress  when  it  obtained  approval  to 
begin  the  project,  nasa’s  “Project  Initiation  Agreement”  is  a  good  source 
for  this  information,  since  it  is  the  result  of  nasa’s  non-advocate  cost 
reviews  preceding  the  congressional  new-start  presentation.  Although 
the  “Primary  nasa  Program  Office”  cost  estimate  will  be  included,  the 
"Supporting  NASA  Program  Offices”  and  non-NASA  cost  estimates  may  not 
be  fully  available  until  nasa  has  a  more  complete  picture  of  the  project  s 
costs. 

The  “Development  Estimate”  completes  and  updates  the  Initial  Project 
Estimate”  by  identifying  the  remaining  cost  components  and  by  refining 
the  original  cost  estimates.  The  “Development  Estimate”  is  usually 
available  around  the  time  of  the  project’s  Preliminary  Design  Review. 
The  Preliminary  Design  Review  usually  occurs  about  2  years  after  new¬ 
start  approval. 

The  “Development  Estimate”  for  the  “Primary  nasa  Program  Office” 
cost  estimate,  project  milestones,  and  performance  and  goals  statements 
can  be  documented  from  the  project’s  approved  “Project  Plan”  and 
“Project  Approval  Document.”  The  “Project  Approval  Document  can 
also  be  used  to  document  the  “Supporting  NASA  Program  Offices”  cost 
estimates. 
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Once  established,  the  “Initial  Project  Estimate”  and  the  “Development 
Estimate”  will  be  repeated  on  all  subsequent  PSRs. 

The  “Last  psr  Estimate”  lists  the  estimated  amounts  shown  on  the  PSR 
preceding  the  current  one.  The  column  labeled  “This  PSR  Estimate  dis¬ 
plays  the  most  current  estimate.  The  “Amount  of  and  Reason  for 
Change”  column  displays  the  difference  between  the  columns  “This  psr 
Estimate”  and  “Last  psr  Estimate”  and  provides  a  brief  but  specific 
explanation  for  this  difference.  For  example,  any  major  design  changes 
should  be  highlighted.  Source  documents  for  any  changes  and  their 
explanations  include  the  facs  database.  Program  Operating  Plans,  and/ 
or  the  program  office’s  most  recent  monthly  Project  Management  Report 
or  status  reviews. 


Part  III  -  Funding  for 
Project  Development 


"Part  III  -  Funding  for  Project  Development”  charts  the  “Project 
Development  Funding”  both  historically  and  prospectively.  This  funding 
corresponds  to  the  amount  listed  by  project  line  item  in  NASA’s  Budget 
Estimates.  (See  figure  III.6.) 


Figure  III.6:  Funding  for  Project  Development _ 

PART  III  —  FUNDING  FOR  PROJECT  DEVELOPMENT 
(Real-Year  Dollars  in  Thousands) 
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The  tracking  begins  with  the  “Prior  Years”  amount,  which  is  the  total  of 
all  project  spending  beginning  in  the  fiscal  year  the  project  first  received 
congressional  approval  up  to  2  fiscal  years  prior  to  the  current  fiscal 
year.  For  example,  if  the  current  fiscal  year  is  1990,  the  “Prior  Years” 
amount  would  cover  all  spending  up  through  and  including  fiscal  year 
1987.  Information  from  NASA’s  facs  database  can  document  this  entry. 
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“Project  Development  Funding”  for  the  current  and  the  previous  2  fiscal 
years — which  are  identified  as  “Current  FY  1990,”  “FY  1989,  and 
“FY  1988"  in  our  extimple— should  correspond  to  amounts  recorded  in 
NASA’S  most  current  Operating  Plans  (Op  Plan)  for  those  years.  The  fig¬ 
ure  entered  as  “Fiscal  Year  Request”  should  correspond  to  the  current 
NASA  budget  request — which  would  be  FY  1991  in  our  example.  The 
next  “FY  ”  column— “FY  1992”  in  our  example— presents  one  esti¬ 
mated  outyear.  The  “Balance  to  Complete”  column  records  the  differ¬ 
ence  between  the  total  “Current  Project  Development  Cost  Estimate 
and  the  sum  of  all  preceding  entries  in  Part  111.  The  “Current  Project 
Development  Cost  Estimate”  total  should  correspond  to  the  most  cur¬ 
rent  “Primary  nasa  Program  Office”  development  estimate  recorded  in 
Part  II  of  the  PSR.  Figure  III.7  presents  Part  III  annotated  with  the 
sources  of  information. 


Figure  III.7:  Instructions  for  Completing  Part  III _ _ _ _ _ 

PART  III  —  FUNDING  FOR  PROJECT  DEVELOPMENT 
(Real-Year  Dollars  in  Thousands) 
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PSR 

Part  11 

®  The  -Current  Project  Development  Co«l  Estimate'  minus  the  total  of  'Prior  Years'  and  ail  -FT  ojlumns. 


"Part  IV  -  Principal  Milestones”  tracks  the  project’s  progress  towards 
P&rt  IV  -  ±  nriCipSJ.  completion  of  its  principal  milestones.  The  principal  milestones  are  dis- 

]VIil6Ston6S  played  vertically  down  the  left-hand  column,  and  progress  is  tracked 

horizontally.  (See  figure  III.8.) 
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Figure  HI.8:  Principal  Milestones 

i  '  PART  IV—  PRINCIPAL  MILESTONES 
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The  milestones  considered  to  be  principal  will  vary  slightly,  depending 
on  the  nature  of  the  project.  The  milestones  in  Part  IV  are  defined  as 
follows: 

The  date  of  the  “Announcement  of  Opportunity”  (if  applicable)  is  the 
day  that  the  scientific  community  is  invited  to  participate  in  a  NASA  pro¬ 
gram  or  project. 

The  date  of  “Development  Contracts  Awarded”  is  the  date  when  all 
prime  contracts  have  been  awarded. 

The  date  of  “All  Preliminary  Design  Reviews  Completed”  is  the  date 
that  the  last  project  element  is  reviewed  for  technical  compatibility  with 
the  project  requirements. - 


-NASA  will  usually  conduct  septirate  reviews  for  each  project  element  at  each  level  of  management. 
For  example,  a  deep  space  science  mission  will  have  preliminary  and  critical  design  reviews  for  the 
spacecraft  and  for  eat.h  on-board  experiment  at  the  contractor,  field  center,  and  NASA  Headquarters 
levels. 
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The  date  recorded  as  “All  Critical  Design  Reviews  Completed”  is  the 
date  when  the  last  project  element  is  reviewed  to  ascertain  whether  the 
design  complies  with  nasa  requirements.  The  critical  design  review  typi¬ 
cally  occurs  when  the  detailed  design  is  90-percent  complete. 

The  “Launch  Date”  is  the  date  the  space  shuttle  or  expendable  launch 
vehicle  is  scheduled  to  launch  the  project.  For  a  project  requiring  more 
than  one  launch,  such  as  tdrss,  “Final  Satellite  Launch”  may  be  an 
appropriate  milestone. 

The  “Project  Completion”  date  is  the  date  that  nasa  managers  can  make 
a  reasonable  assessment  of  the  project’s  final  performance  in  relation  to 
its  stated  goals  and  objectives.  The  “Project  Completion”  will  vary, 
depending  on  the  nature  of  these  goals  and  objectives. 

For  example,  the  “Project  Completion”  date  for  a  project  with  a  science 
goal  would  be  the  date  that  nasa  managers  are  able  to  make  preliminary 
analyses  of  how  well  the  data  obtained  contributes  to  the  project’s  goals. 
In  the  case  of  Magellan,  a  NASA  scientist  told  us  that  they  will  be  able  to 
assess  how  well  the  project  has  fulfilled  its  stated  science  goal  (“to 
address  fundamental  questions  regarding  the  origin  and  evolution  of 
Venus”)  when  it  has  completed  its  objectives  (one  of  which  is  “to  map 
the  planet  over  a  243  day  period — one  Venus  year”),  nasa  sometimes 
refers  to  the  completion  of  objectives  as  the  “nominal  mission  complete” 
date.  Therefore,  although  making  a  definitive  statement  on  how  well 
Magellan  achieved  its  science  goals  will  require  many  more  years  of  data 
analysis,  a  reasonable  “Project  Completion"  date  would  be  the  date  that 
the  project  has  completed  its  nominal  mission.'* 

A  different  determination  for  “Project  Completion”  is  made  for  a  project 
the  goal  of  which  is  to  be  put  into  routine  use  or  to  become  operational. 
For  example,  nasa  could  identify  the  project  completion  date  for  a  space 
transportation  system  such  as  the  Advanced  Solid  Rocket  Motor  as  the 
“First  Operational  Flight”  or  the  date  when  testing  is  complete  and  the 
motor  is  put  into  routine  use.  For  a  system  such  as  tdrss,  operational 
status  would  be  achieved  when  testing  of  the  full  constellation  of  tdrss 
satellites  is  completed.  Therefore,  “First  Operational  Use”  of  the  full 
system  could  be  an  appropriate  milestone  to  mark  project  completion. 


'*NASA  officials  told  us  that  a  “Final  Science  Report"  is  routinely  prepared  for  all  science  projects 
after  the  nominal  mission  has  been  completed.  This  report  makes  an  assessment  of  the  project's 
achieved  goals. 
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Ject  Estimate.”  'mtilar  to  those  Iti  Part  11.  (See  our  dls- 

“il»  hS»  >«<>” 

pp.  33-34.)  _ _ _ _ _ 


Figure  111 


q.  u.^rting,  for  Tracking  Principal  Milestones _ 


REASON  FOR  CHANGE 


Part  V  -  Project  Goals 
and  Objectives 


There  is  one  slight  variation  indi- 

IV’s  “This  PSR  Estimate/Actu  .  ;„k  f*')  to  signify  that  the  event 

eating  a  completed  event  using  an  asterisk  ( )  to  signiiy 

has  occurred. 

meeting  its  goals  and  used  in  Parts  II  and  IV— 

track  progress  in  this  part  ‘Deveb^^^ 

that  .lys?'  «  to  (lhange,"  and  -Final 

Estimate.  Ffl  J  ^  discussion  of  these  baselines  in  our 

Performance  Statement.  (_be  ^  00  04  ”,  part  V,  however,  dif- 

section  “Eatlntate/Change  ^  Che  tracking 

fern  in  the  form  of  P”™'"' O”*” 
points  horizontally,  Pa  r^rpcipnt  the  narrative  information 

left-hand  column  Goals’’  and  “Science/Techni- 

under  the  two  )  The  information  should  be  presented 

information  does  not  fit  within  the  space  provided,  Part 
expanded  to  two  pages. 
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Figure  111.10  Project  Goals  and  Objectives 
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“Project  Goals”  should  be  stated  as  the  reasons  for  doing  the  project. 

For  example,  Magellan's  project  goal  is  to  “to  address  fundamental  ques¬ 
tions  regarding  the  origin  and  evolution  of  Venus.’  An  example  of  an 
operational  project  goal  is  provided  by  the  Advanced  Solid  Rocket  Motor 
project,  the  goal  of  which  is  to  increase  the  space  shuttle  payload  capac¬ 
ity  by  12,000  pounds. 

The  “Science/Technical  Objectives”  section  should  specifically  and 
quantifiably  describe  how  the  project  will  achieve  its  goals.  For  exam¬ 
ple,  the  "Science  Objectives"  for  Magellan,  as  stated  in  Magellan’s 
Project  Plan  and  Project  Approval  Document,  are  to 

map  70  to  90  percent  of  Venus,  with  no  systematic  gaps  except  for  one 
pole,  with  a  surface  resolution  of  at  least  500  meters  and  an  image  reso¬ 
lution  of  1  kilometer  or  better; 

produce  maps  that  reveal  the  topographic  and  radar-scattering  charac¬ 
teristics  of  Venus;  and 

refine  the  low-degree  and  low-order  gravity  field  of  Venus  and  produce 
high-resolution  gravity  maps  whenever  possible. 

The  “Technical  Objectives”  section  should  identify  the  engineering 
information,  hardware,  and  instrumentation  needed  to  achieve  the  pro¬ 
ject’s  goals.  For  example,  the  technical  objectives  for  the  Advanced  Solid 
Rocket  Motor  could  include 


the  development  of  materials  and  casting  processes  that  can  produce  a 
150-inch  diameter  motor  and 

the  use  of  new  non-asbestos  insulation  materials  in  conjunction  with 
weldable  T-250  steel  and  High  Thrust  Prolonged  Bum  propellant. 

As  with  Parts  II  and  IV,  the  “Initial  Project  Presentation  to  Congress" 
records  the  “Project  Goals”  and  “Science/Technical  Objectives”  state¬ 
ments  made  by  nasa  during  the  new-start  approval  process  and  docu¬ 
mented  in  the  “Project  Initiation  Agreement.”  The  “Development 
Estimate”  records  the  more  detailed  and  further  defined  statements  of 
goals  and  objectives  that  nasa  develops  for  the  Project  Plan. 

For  the  sake  of  brevity.  Part  V  can  describe  the  “Last  psr”  and  "This 
PSR”  as  the  “Same  as  the  Development  Estimate”  or  the  “Same  as  the 
Initial  Project  Presentation  to  Congress,”  when  applicable.  If  a  change  is 
made,  the  “Last  psr”  block  should  list  the  previous  goals  and  objectives, 
and  the  “This  psr”  block  should  list  the  new  ones.  Relevant  source  docu¬ 
ments  supporting  the  continuation  of  or  changes  in  project  goals  and 
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Part  VI  -  Project 
Background 


monthly  project  Management  Reports  and 
status  reviews.  The  “Reason  for  Change’’  column  is  used  to  explain  any 
differences  between  “This  psr”  and  the  Last  psr. 

The  “Final  Performance  Statement’’  should  assess  how  well  the  prpiect 
fulfilled  its  stated  goals  and  objectives,  For  example,  Magellan  project 
m»«rfsh?uid  mate  a  tlaal  statement  as  to  what  percenuge  of  Venus 
was  mapped,  what  types  of  maps  were  produced  and  at  what  resolution, 
and  whether  the  maps  revealed  the  desired  information  about  Vem^. 
TlTnffmation  can  be  documented  by  NASA’s  “Final  Science  Report. 

Le  our  section  on  “Milestones”  for  an  explanation  of  this  report. 


“Part  VI  -  Project  Background”  provides  information  on  the  Project  s 
8e?a«o«ship  i  sasa's  Strategic  Plan.  •  the  -  General  Bach6™und  of  the 
nrniect  the  nroiect’s  “Primary  NASA  Components  and  Their 
Lsponsibilities.”  "Prime  Contractors  f T 

"Other  Participants  and  Their  Responsibilities.  (See  figure  IIMl.) 
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Figure  111.11:  Project  Background 
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PRIME  CONTRACTORS  AND  THEIR  RESPONSIBILITIES 


I  OTHER  PARTICIPANTS  AND  THEIR  RESPONSlBlLlTieS 
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Appendix  lH 

Completing  the  PSR  Fonn 


The  “Project’s  Relationship  to  NASA's  Strategic  Plan”  should  provide  a 
brief  analysis  of  the  relationship  between  the  project's  goals  as  stated  in 
NASA’s  Strategic  Plan  (when  available)  and  the  project’s  goals  as  stated 
in  the  primary  program  office’s  strategic  plan.  This  section  should  also 
describe  any  project’s  contribution  and/or  its  relationship  to  other  nasa 
missions.  For  example,  many  scientists  consider  the  origin  and  evolution 
of  Venus  to  be  similar  to  the  origin  and  evolution  of  Earth.  Therefore, 
learning  more  about  the  origin  and  evolution  of  Venus  could  contribute 
to  NASA’s  mission  to  better  understand  the  planet  Earth. 

“General  Background”  should,  at  a  minimum,  contain 

the  Project  Approval  Date  (the  month  and  year  that  the  project  first 
received  congressional  new-start  approval)  and 
the  amount  of  time  and  money  spent  on  the  project  before  it  received 
new-start  approval  (during  Advanced  Studies). 

Examples  of  other  information  that  could  be  included  in  “General 
Background”  include 

a  description  of  any  plans  to  extend  a  science  mission,  what  science 
goals  would  be  obtained,  and  what  the  mission  extension  would  cost  and 
an  estimate  of  the  annual  operating  cost  for  operational  projects  once 
they  have  reached  fully  operational  status. 

“Primary  NASA  Components  and  Their  Responsibilities”  should  list  naS-A 
components  (headquarters  program  offices  and  field  centers)  that  are 
extensively  involved  in  the  project  and  their  responsibilities. 

“Prime  Contractors  and  Their  Responsibilities”  should  list  all  prime  con¬ 
tractors  and  the  goods  or  services  they  are  obligated  to  provide. 

“Other  Participants  and  Their  Responsibilities”  should  list  the  roles, 
responsibilities,  and  contributions  of  other  involved  participants,  such 
as  foreign  and/or  domestic  commercial  or  academic  organizations  or 
individuals. 


Page  43 


GAO/NSIAD-9(MO  NASA  Project  Status  Reports 


Appendix  IV - - - - - - - 

Major  Contributors  to  This  Report 


.  _  .  ,  Frank  Degnan,  Assistant  Director 

National  becunty  ana  ^^ren  L.  Kemper,  Evaluator-in-Charge 
International  Affairs  Amy  L.  Manheim,  Evaluator 

Division,  Washington, 

D.C. 


Los  Angeles  Regional 
Office 


Allan  Roberts,  Regional  Assignment  Manager 
Jeffrey  Webster,  Site  Senior 
Dawn  Sellers,  Evaluator 


(392444) 
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Requests  for  copies  of  <JAO  reports  should  be  sent  to: 

U.S.  General  Accounting  Office 
Post  Office  Box 
Gaithersburg,  Maryland  20877 

Telephone  202-275-6241 

The  first  five  copies  of  each  report  are  free.  Additional  copies  are 
$2.00  each. 

There  is  a  25%  discount  on  orders  for  i  00  or  more  copies  mailed  to  a 
single  address. 

Orders  m  ast  be  prepaid  by  cash  or  by  check  or  money  order  made 

out  to  the  Superintendent  of  Documents. 
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